Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: processor service integration #22

Merged
merged 7 commits into from
Nov 5, 2024

Conversation

0xnigir1
Copy link
Collaborator

@0xnigir1 0xnigir1 commented Nov 4, 2024

🤖 Linear

Closes GIT-74 GIT-75

Description

  • processor app that integrates all the Core components of the processing pipeline and runs a single chain Orchestrator
  • bump envio version
  • some bug fixes

Checklist before requesting a review

  • I have conducted a self-review of my code.
  • I have conducted a QA.

Copy link

linear bot commented Nov 4, 2024

jahabeebs
jahabeebs previously approved these changes Nov 5, 2024
Copy link
Collaborator

@jahabeebs jahabeebs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice! 🚀


### ⚙️ Setting up env variables

- Create `.env` file and copy paste `.env.example` content in there.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would add: "or run the below command"

@@ -26,8 +21,8 @@ export class IpfsProvider implements IMetadataProvider {
ipfsCid: string,
validateContent?: z.ZodSchema<T>,
): Promise<T | undefined> {
if (!isValidCid(ipfsCid)) {
throw new InvalidCidException(ipfsCid);
if (ipfsCid === "" || !isValidCid(ipfsCid)) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

logging might be good here if just returning undefined

Copy link
Collaborator Author

@0xnigir1 0xnigir1 Nov 5, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could be, i think here i'll leave the responsibility of logging to the caller

| `DATABASE_URL` | PostgreSQL Data Layer database connection URL | N/A | Yes | |
| `DATABASE_SCHEMA` | PostgreSQL Data Layer database schema name | chainDataSchema | Yes | |
| `INDEXER_GRAPHQL_URL` | GraphQL endpoint for the indexer | N/A | Yes | |
| `INDEXER_ADMIN_SECRET` | Admin secret for indexer authentication | N/A | Yes | |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should change this, admin secret is just for admins, should be a way to generate some token for client auth

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

| `INDEXER_ADMIN_SECRET` | Admin secret for indexer authentication | N/A | Yes | |
| `IPFS_GATEWAYS_URL` | Array of IPFS gateway URLs | N/A | Yes | Multiple gateways for redundancy |
| `COINGECKO_API_KEY` | API key for CoinGecko service | N/A | Yes | |
| `COINGECKO_API_TYPE` | CoinGecko API tier (demo or pro) | N/A | Yes | |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lets use default pro here

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

give me my Pro Key xd

let processor: ProcessorService;

const main = async (): Promise<void> => {
processor = new ProcessorService(environment);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about using Processing instead of Processor to avoid confusion with the event processors, if we modify this we should include modifying file names also

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

aaa okay makes sense, Processor was a more natural naming. the app folder should also be apps/processing?

@0xnigir1 0xnigir1 merged commit 43b6574 into dev Nov 5, 2024
6 checks passed
@0xnigir1 0xnigir1 deleted the feat/processor-service-integration branch November 5, 2024 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants